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Report  of  the  Results  of  SIM.QM-P6: 
UV/Visible  Spectrophotometry  Wavelength  Standard 
Interlaboratory  Comparison 

John  C.  Travis,  Melody  V.  Smith,  David  L.  Duewer 


Abstract 

A study  was  designed  to  compare  wavelength  axis  measurements  in  ultraviolet  and  visible  (uv/vis) 
spectrometry  at  several  laboratories  of  the  Interamerican  Metrology  System  (Sistema  Interamericano  de 
Metrologia,  or  SIM)  using  holmium  oxide  solution  Certified  Reference  Materials  (CRMs).  The  goals  of 
the  study  were  to  demonstrate  comparability  of  wavelength  measurements  among  the  participants,  to 
demonstrate  the  comparability  between  National  Institute  of  Standards  and  Technology  (NIST)  and 
Centro  Nacional  de  Metrologia  (CENAM)  versions  of  holmium  oxide  in  perchloric  acid  solution  CRMs, 
to  acquire  holmium  oxide  solution  spectral  data  from  a variety  of  spectrometers  for  use  in  a NIST  study 
of  wavelength  assignment  algorithms,  and  to  provide  a basis  for  a possible  reassessment  of  the  NIST- 
certified  wavelength  values.  The  goals  were  generally  met,  with  widespread  agreement  of  the 
measurements,  evidence  that  sample  origin  is  irrelevant,  and  support  for  re-assignment  of  the  NIST- 
certified  wavelength  values  for  absorption  band  positions  in  SRM  2034. 
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1.  INTRODUCTION 

This  study  of  holmium  oxide  solution  wavelength  Certified  Reference  Materials  (CRMs)  was 
designed  to  compare  wavelength  axis  measurements  in  ultraviolet  and  visible  (uv/vis)  spectrometry  at 
several  laboratories  of  the  Interamerican  Metrology  System  (Sistema  Interamericano  de  Metrologia,  or 
SIM).  The  goals  of  the  study  were  to  demonstrate  the  degree  of  comparability  of  wavelength 
measurements  among  the  participants,  to  demonstrate  the  comparability  between  National  Institute  of 
Standards  and  Technology  (NIST)  and  Centro  Nacional  de  Metrologia  (CENAM)  versions  of  holmium 
oxide  in  perchloric  acid  solution  CRMs,  to  acquire  holmium  oxide  solution  spectral  data  from  a variety 
of  spectrometers  for  use  in  a NIST  study  of  wavelength  assignment  algorithms,  and  to  provide  a basis  for 
a possible  reassessment  of  the  NIST-certified  wavelength  values.  This  study  was  not  intended  to  be  a 
comparison  of  national  wavelength  scales. 


2.  METHODS  AND  MATERIALS 

2.1  Participation 

This  SIM  study  was  conducted  from  April  2000  through  June  2002,  involving  eleven  organizations  in 
seven  nations.  The  study  evolved  from  a comparison  [1]  performed  by  five  organizational  units  in  three 
national  laboratories  within  the  North  American  Cooperation  in  Metrology  (NORAMET),  a subregion  of 
SIM.  Table  1 lists  the  organizations  and  the  individuals  involved  in  the  SIM  study.  Table  2 lists  the 
instruments  and  operating  parameters  used  to  acquire  the  data  sets.  Since  two  data  sets  were  provided  by 
one  participant  using  the  same  instrument  but  at  widely  different  times  and  operating  conditions,  the 
complete  study  consists  of  twelve  data  sets. 

Three  of  the  participants  in  the  original  NORAMET  comparison  were  associated  with  the  discipline 
of  radiometric  physics  while  two  were  primarily  associated  with  chemistry.  All  five  of  these  participants 
used  comparable,  modem  instruments  of  a "conventional”  double-beam  scanning  monochromator  design. 
These  instruments  had  variable,  software-controlled  slits  that  enabled  spectral  acquisition  at  nominal 
spectral  slit  width  (SSW)  settings  of  0.1  nm,  1.0  nm,  and  3.0  nm. 

The  SIM  invitation  was  only  to  laboratories  associated  with  the  discipline  of  chemistry.  The 
majority  of  organizations  expressing  an  interest  in  participation  proposed  use  of  instruments  that  were 
unable  to  acquire  spectra  at  all  three  of  the  desired  SSWs  and/or  were  of  "inverted"  design  (wavelength 
dispersion  following  the  sample,  with  array  detection)  with  fixed  SSW.  Since  such  instruments  represent 
the  majority  of  applications  of  chemical  spectrophotometry,  the  original  protocol  was  modified  to  enable 
participation  by  all  interested  organizations. 

2.2  Samples 

The  sample  kit  contained  four  sealed,  fused-silica  cuvettes  each  filled  with  holmium  oxide  in 
perchloric  acid:  two  samples  each  of  the  CENAM  DMR  41e  (2000)  [2]  and  the  NIST  SRM  2034  (1999) 
[3]  reference  materials.  Each  sample  was  marked  with  a colored  dot  on  the  bottom  of  the  cuvette  to 
permit  easy  identification  of  a particular  sample.  The  kit  also  contained  a copy  of  the  NIST  SRM 
certificate  for  SRM  2034,  NIST  SP  260-102  “Holmium  Oxide  Solution  Wavelength  Standard  From  240 
to  640  nm  - SRM  2034,”  [4]  and  ASTM  Standard  E958-93  (1999)  “Standard  Practice  for  Measuring 
Practical  Spectral  Bandwidth  of  Ultraviolet-Visible  Spectrophotometers,”  [5]  and  the  Materials  Safety 
Data  Sheet  for  holmium  oxide  in  perchloric  acid  solution. 

23  Measurement  Protocol 

Participants  were  requested  to  acquire  transmittance  spectra  for  each  of  the  samples  from  230.0  nm 
to  679.9  nm  with  a data  interval  of  0.1  nm  at  SSWs  of  0.1  nm,  1.0  nm,  and  3.0  nm.  Spectra  were  to  be 
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collected  in  constant  SSW  (fixed-slit)  mode  using  an  airpath  reference.  Participants  using  instruments  of 
limited  SSW  range  were  requested  to  provide  spectra  at  whatever  subset  of  these  three  SSWs  could  be 
achieved.  Participants  using  instruments  of  fixed  SSW  were  requested  to  provide  whatever  spectra  could 
be  acquired,  at  the  suggested  data  density  or  the  highest  data  density  possible.  Participants  were 
requested  to  acquire  spectra  for  each  sample  in  the  same  specified  order  at  each  SSW  evaluated.  To 
enable  assessment  of  short-  and  intermediate-term  variance  components,  participants  were  requested  to 
acquire  two  complete  sets  of  data  in  separate  sessions  at  least  one  day  apart.  Each  participant  was  thus 
requested  to  acquire  8 spectra  (4  samples  x 2 sessions)  for  each  SSW  evaluated. 

Where  practical,  each  instrument’s  wavelength  axis  was  to  be  bias-corrected  by  substituting 
appropriate  atomic  pen  lamps  for  a continuum  lamp  and  fitting  a low  order  polynomial  to  the  bias  vs. 
indicated  wavelength  data.  If  the  requested  pen  lamp  calibration  could  not  be  performed,  participants 
were  requested  to  report  any  wavelength  calibration  measures  taken.  Participants  were  likewise 
requested  to,  where  possible,  verify  actual  spectral  slit  width  values  using  the  method  described  in 
ASTM  958-93  [5]. 

Participants  were  requested  to  report  the  temperature  of  the  sample  at  the  time  of  measurements. 
Some  of  the  participants  reported  the  ambient  temperature  of  the  room  in  which  the  spectrometer  was 
housed  rather  than  the  temperature  within  the  instrument’s  sample  chamber. 

Participants  were  asked  to  report  evaluated  band  locations  and  associated  uncertainties  for  the  14 
bands  identified  in  Figure  1 (the  bands  certified  for  location  in  NIST  SRM  2034),  along  with  a 
description  of  the  band  location  method  or  algorithm  used.  Unmodified  spectra  in  text  or  spreadsheet 
format  were  also  requested  so  that  the  same  polynomial  interpolation  location  algorithm  could  be  applied 
to  all  spectra.  One  participant  ("d")  provided  spectra  in  a proprietary  format  that  could  not  be  decoded. 

2.4  Band  Location 

Band  locations  for  all  spectra  furnished  in  a readable  format  were  determined  at  NIST’s  Chemical 
Science  and  Technology  Laboratory  (CSTL)  using  both  the  data  minimum  and  cubic  interpolation 
methods  described  in  Ref.  [1].  Calibration  corrections  were  applied  if  furnished  by  the  participant.  The 
calibrated  locations  determined  by  the  CSTL  algorithms  were  compared  to  those  furnished  by  the 
participant.  With  the  exception  a few  bands  in  one  set  of  spectra  having  atypically  high  photometric 
noise/signal,  the  two  location  estimates  agreed  within  ±0.01  nm.  The  location  of  the  bands  having  the 
least  optical  depth  (especially  band  8)  in  the  “noisy”  spectra  were  more  repeatably  located  by  the 
participant  than  by  the  data  minimum  or  the  CSTL  interpolation  algorithm. 

To  reflect  participant  measurement  systems  while  using  the  most  consistent  and  most  appropriate 
band  location  measurements,  the  following  discussion  is  based  upon  the  analysis  of:  1 ) participant- 
provided  interpolated  band  locations,  2)  CSTL-interpolated  locations  when  participants  provided  spectra 
but  not  interpolated  locations,  and  3)  participant-provided  data  minima  when  neither  interpolated 
locations  nor  readable  spectra  were  provided.  Table  2 lists  the  band  locations  algorithms  used  for  each 
data  set. 


3.  RESULTS  AND  DISCUSSION 

3.1  Measured  Positions  of  Certified  Bands  and  Inter-laboratory  Variability 

Tables  3-6  summarize  the  band  location  results  for  all  participants,  band  positions,  and  SSW 
values.  Tables  3 - 5 are  for  nominal  SSW  values  of  0.1  nm,  1 .0  nm,  and  3.0  nm,  respectively;  Table  6 
reports  results  for  instruments  of  nominal  SSW  1.6  nm  and  2.2  nm.  The  NIST  SRM  2034(01)  certified 
band  locations  and  associated  uncertainties  for  the  appropriate  SSW  of  the  14  bands  is  given  to  the  left  of 
each  table.  Each  value  in  the  remaining  columns  represents  the  difference  between  the  average  of  eight 
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determinations  (4  samples  x 2 replicate  measurements)  by  a given  participant  and  the  certified  value, 
along  with  the  standard  deviation  of  the  eight  determinations.  For  Table  6,  the  reference  values  and 
uncertainties  are  interpolated  from  the  certified  values. 

None  of  the  reported  band  locations  for  the  0.1  nm,  1.0  nm,  and  3.0  nm  SSW  spectra  are  outside  of 
the  certified  value  range  specified  in  Reference  [3].  Several  band  locations  for  the  2.2  nm  SSW  spectra 
are  outside  of  the  expected  range  (italicized  values  in  Table  6).  Since  there  are  both  positive  and 
negative  differences,  it  is  unclear  whether  these  excursions  are  attributable  to  the  particular  spectra,  the 
intrinsic  performance  of  the  instrument,  or  to  the  interpolation  process  used  to  establish  the  reference 
location  and  uncertainty  values  for  this  SSW.  Both  of  the  1.6  nm  SSW  instruments  appear  to  provide 
locations  that  are  systematically  higher  than  expected,  although  generally  within  the  0.5  nm  data 
granularity  set  by  the  instrument’s  1.0  nm  data  spacing. 

Figures  2-4  display  the  differences  between  each  average  band  position  and  the  certified  value  as 
functions  of  the  nominal  wavelength  for  all  participants  providing  data  at  0.1  nm,  1 .0  nm,  or  3.0  nm 
SSW.  Individual  participant  uncertainties  are  omitted  for  clarity,  as  uncertainty  issues  are  separately 
discussed  below.  The  bars  span  ±twice  the  among-participant  standard  deviations  (i.e.,  the  expanded 
uncertainties  using  a coverage  factor  of  k = 2)  about  each  average.  Figure  5 similarly  displays  the 
differences  for  three  fixed-slit  instruments  of  1 .6  nm  or  2.2  nm  SSW,  with  insufficient  data  to  compute 
among-participant  expanded  uncertainties. 

3.2  Central  Values  for  Band  Positions 

Figures  2-4  clearly  support  the  need  to  reassign  the  certified  values  for  some  bands  of  SRM  2034  in 
addition  to  re-evaluating  the  uncertainties.  The  clearest  example  is  band  13  at  1 .0  nm  (Figure  3),  for 
which  all  SIM  participants  found  lower  values  than  certified.  Figure  3 also  implicates  bands  6,  7,  and, 

12,  with  apparently  high  certified  values.  Figure  2 illustrates  the  potential  problems  with  bands  12,  13 
and  14  at  0.1  nm  SSW.  Figure  4 shows  a curious  "drift"  of  the  data  to  high  values  with  decreasing 
wavelength  at  3.0  nm  SSW.  This  could  represent  a skew  in  the  nominally  triangular  slit  function  in  the 
original  certifying  instrument,  resulting  from  non-uniform  illumination  of  the  wide  entrance  slit.  The 
effect  of  such  a skew  would  be  magnified  in  the  UV,  due  to  the  lower  relative  width  of  the  bands  there 
when  displayed  in  constant  wavelength  increments. 

A multi-center  exercise  of  similar  protocol  to  the  one  reported  here  is  currently  underway  to  address 
the  need  to  re-assign  the  band  positions.  Calibrated  SIM  data  will  be  used  in  this  re-assignment  of  the 
band  positions  and  uncertainties  for  SRM  2034. 

3.3  Uncertainties  in  Band  Position  Assignment 

The  lower  segment  of  each  of  Figures  6-19  displays  all  band  locations  (relative  to  their  average 
value)  reported  for  a given  band  by  all  participants  for  all  SSW  values.  The  individual  measurements  are 
alphabet-  and  color-coded  to  correspond  to  the  four  samples  marked  as  Red  and  Blue  (NIST  SRM  2034) 
and  Green  and  Yellow  (CENAM  DMR  41e).  The  symbols  are  in  lower  case  for  measurements  on  the 
first  day  and  upper  case  for  the  second  day.  Light  dotted  lines  at  ±0.05  nm  represent  the  bias  that  might 
result  from  the  granularity  of  the  0.1  nm  data  spacing  if  one  were  to  employ  the  simplest  band  location 
algorithm  of  all  - the  location  of  the  minimum  data  point. 

The  "scatter"  along  the  ordinate  in  these  plots  is  representative  of  the  "within  instrument"  variance 
component,  including  possible  effects  due  to  sample  differences  and  measurement  repeatability 
(discussed  below).  By  visual  comparison  of  the  "within  instrument"  scatter  in  Figures  6-19  and  the 
"among  instrument"  scatter  in  Figures  2 - 5,  it  is  clear  that  instrument  to  instrument  differences  are  the 
largest  component  of  band  location  uncertainty.  For  0.1  nm  and  1.0  nm  SSW  values,  the  "within 
instrument"  scatter  of  Figures  6 - 19  is  consistent  with  the  claim  of  many  laboratories  to  be  able  to 
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calibrate  instruments  to  an  accuracy  of  ±0.1  nm,  the  overall  uncertainty  quoted  for  SRM  2034  for  all 
bands  and  SSW  values  prior  to  Series  2002.  However,  the  legitimacy  of  this  claim  to  accuracy  is  called 
into  question  by  the  differences  among  instruments  calibrated  to  atomic  wavelength  standards  by 
qualified  operators. 

For  this  reason,  the  findings  from  the  NORAMET  study  were  used  to  recalculate  the  overall 
uncertainties  for  the  certified  bands  for  the  Series  2002  certificate  for  NIST  SRM  2034,  shown  as  ±U95  in 
the  tables.  These  uncertainties  were  constructed  to  allow  for  the  variance  components  identified  in  the 
study  in  addition  to  a component  added  linearly  to  account  for  the  bias  between  the  certified  value  and 
the  average  of  the  values  determined  by  all  of  the  NORAMET  instruments. 

Recertification  of  the  band  positions  will  remove  the  "bias”  component  of  the  uncertainty,  but  it  is 
clear  that  the  uncertainties  will  average  closer  to  ±0.2  nm  than  to  the  prior  value  of  ±0.1  nm,  and  that 
individual  uncertainties  for  each  band  and  SSW  are  called  for  by  the  varying  band  shapes  encountered. 

3.4  Sample-to-sample  and  Replication  Variability 

Holmium  oxide  solution  made  according  to  a well-defined  composition  and  procedure  could  be 
declared  an  "intrinsic  standard"  if  it  can  be  shown  that  the  band  positions  are  robust  with  respect  to  a 
reasonable  variation  in  sample  preparation  parameters.  The  present  study  addresses  that  issue  through 
the  presence  of  reference  materials  separately  prepared  by  NIST  and  CENAM. 

The  uppermost  plots  in  Figures  6-19  represent  the  standard  uncertainty  component  which  may  be 
assigned  to  differences  among  the  samples  (“heterogeneity”,  closed  circles)  and  that  which  represents 
replication  on  separate  days  with  removal  and  replacement  of  the  sample  (“repeatability”,  open  circles). 
Variability  among  the  samples  would  cause  the  component  due  to  sample  difference  to  routinely  exceed 
that  resulting  from  simple  replication,  whereas  the  opposite  is  observed.  The  fundamental  conclusion  is 
that  the  four  samples  can  not  be  distinguished  on  the  basis  of  band  location. 

Since  replication  was  on  separate  days,  there  may  be  some  question  of  the  importance  of  a "day" 
effect  as  opposed  to  a simple  replication  effect.  Examination  of  the  lower  case  (Day  1)  and  upper  case 
(Day  2)  data  of  the  lower  plots  suggests  that  replication  with  removal  and  replacement  of  the  sample  is 
the  source  of  the  variability  rather  than  a "day"  effect. 


4.  CONCLUSIONS 

1)  All  the  band  locations  measured  by  participants  at  0.1  nm,  1.0  nm,  and  3.0  nm  SSW  were  consistent 
with  the  certified  values  for  NIST  SRM  2034  at  a level  appropriate  to  the  95%  confidence  limit 
uncertainties  given  in  the  Series  02  certificate  for  that  material. 

2)  Sample  pairs  produced  by  NIST  and  CENAM  were  indistinguishable  within  and  across  production 
laboratories. 

3)  Instrument-to-instrument  variability  exceeded  the  estimated  wavelength  uncertainty  of  most 
participants  by  nearly  two-fold.  Individual  instruments  seem  to  exhibit  minor  variations  about  a 
"smooth"  calibration  curve  due  to  characteristics  of  individual  gratings,  sine-bar  drives,  and  so  forth. 

4)  It  is  recommended  that  multiple  instruments  be  involved  in  the  assignment  of  wavelength  values  and 
uncertainties  to  spectral  features  for  use  as  absorptive  wavelength  standards.  Calibrated  SIM  results 
will  be  combined  with  others  from  a wider  international  participation  to  re-assign  certified  values  for 
NIST  SRM  2034. 
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Table  1 
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Country 
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Canada 
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& Tobago 


USA 

USA 


Organization 

Instituto  Nacional  de  Tecnologia  Industrial  (INTI) 
Centro  de  Investigation  en  Tecnologia  e 
Industrialization  de  Alimentos  (CEIAL) 

Parque  Tecnologico  Miguelete 
San  Martin  (1650) 

Buenos  Aires 

Instituto  Nacional  de  Tecnologia  Industrial  (INTI) 
Misiones  1156(1 876) 

Bernal 

Buenos  Aires 

Institute  for  Technological  Research  of  Sao  Paulo  State 
Optical  Laboratory 

Mechanical  and  Electrical  Engineering  Division 

Av.  Prof.  Almeida  Prado,  532  - Cid.  Universitaria 

CEP:  05508-901  Butanta  Sao  Paulo  SP 

Institute  of  National  Measurement  Standards 

National  Research  Council  Canada 

Ottawa,  Ontario  K1A  0R6 

Laboratorio  de  Metrologia 

Escuela  de  Quimica 

Universidad  de  Costa  Rica 

Metals  Division 

Centro  Nacional  de  Metrologia 

76900  Queretaro 

Optical  and  Radiometric  Division 
Centro  Nacional  de  Metrologia 
76900  Queretaro 

Trinidad  & Tobago  Bureau  of  Standards 
PO  Box  467 
Port  of  Spain 
Ministry  of  Health 

Drug  Lab,  Chemistry  Food  and  Drugs  Division 
115  Frederick  Street 
Port  of  Spain 

Chemical  Science  and  Technology  Laboratory 
National  Institute  of  Standards  and  Technology 
Gaithersburg,  MD  20899-8394 
Physics  Laboratory 

National  Institute  of  Standards  and  Technology 
Gaithersburg,  MD  20899-8441 


Coordinators/Analysts 

Celia  Puglisi 


Celia  Puglisi 


Tsai  Soi  Mui  Lee 

Oswaldo  Luiz  Bueno  Martins 

Antonio  Francisco  Gentil  Ferreira  Jr. 


Joanne  Zwinkels,  Mario  Noel 
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Flora  Mercader 
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Debbie  Dindial 

Rosemary  James 

Debbie  Dindial  (TTBS/coord.) 
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Marissa  Maley,  David  Duewer, 
Gary  Kramer 

Edward  Early,  Kenneth  Eckerle 
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Table  3 

Differences  from  SRM  2034  Certified  Values  for  0.1  nm  SSW  Measurements 
A = (Measurement  - SRM  2034  Certified),  nm 
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Figure  1:  Typical  0.1  nm  SSW  Spectrum  of  HcbCF,  in  Dilute  Perchloric  Acid. 
Band  labels  are  as  assigned  in  Reference  [3] 
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Figure  2:  Differences  from  SRM  2034  Certified  Values  for  0.1  nm  SSW  Measurements 
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Figure  3:  Differences  from  SRM  2034  Certified  Values  for  1.0  nm  SSW  Measurements 
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Figure  4:  Differences  from  SRM  2034  Certified  Values  for  3.0  nm  SSW  Measurements 
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Figure  5:  Differences  from  SRM  2034  Certified  Values  for  1.6  and  2.2  nm  SSW  Measurements 
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Figure  6:  Relative  Measurements  and  Components  of  Variance  for  Band  1 
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Figure  7:  Relative  Measurements  and  Components  of  Variance  for  Band  2 
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Figure  8:  Relative  Measurements  and  Components  of  Variance  for  Band  3 
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Figure  9:  Relative  Measurements  and  Components  of  Variance  for  Band  4 
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Figure  10:  Relative  Measurements  and  Components  of  Variance  for  Band  5 
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Figure  11:  Relative  Measurements  and  Components  of  Variance  for  Band  6 
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Figure  12:  Relative  Measurements  and  Components  of  Variance  for  Band  7 
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Figure  13:  Relative  Measurements  and  Components  of  Variance  for  Band  8 


in 

04 


(73 

JD 

JO 

a 

H 

vo 


I 


s' 


C/D 


5 

c/5 

> 

XI 

“O 

0 

Cl 

3 

o 

(5 

=*=* 

c 

CO 

Q. 

O 

■c 

CO 

CL 

CO 
-»— » 

0 

C/5 

0 

-»=» 

0 

O 


ujU  ,0J9^s  $ *B3dajs  iuu  luB0|/\|  - pejnsB0|/\| 


Figure  14:  Relative  Measurements  and  Components  of  Variance  for  Band  9 
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Figure  15:  Relative  Measurements  and  Components  of  Variance  for  Band  10 
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Figure  16:  Relative  Measurements  and  Components  of  Variance  for  Band  1 1 
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Figure  17:  Relative  Measurements  and  Components  of  Variance  for  Band  12 
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Figure  18:  Relative  Measurements  and  Components  of  Variance  for  Band  13 
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Figure  19:  Measurements  Relative  to  Participant  Averages  and  Components  of  Variance  for  Band  14 


